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ABSTRACT 

The present invention provides a method and system for grid computing. In an embodiment, 
a plurality of client machines are interconnected to at least one master machine. The master 
machine assigns a portion of a computing task to each one of the client machines. If any 
given client machine fails, or is delayed, in the performance its portion of the task, the master 
machine uses an estimate of that particular portion when presenting output for the task. 
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SYSTEM AND METHOD FOR GRID COMPUTING 



Field Of The Invention 

S The present invention relates to generally to computing and more particularly to a method 

and system for grid computing. 

Background of the Invention 

The interconnection of relatively inexpensive microcomputers via networks, such as the 

10 Internet, presents opportunities to provide computing power that can rival very costly 
supercomputers. Known as grid computing, the harnessing of such computing power typically 
involves a master computer that assigns portions of a computing task to a plurality of discrete 
client computers via a network. 

One of the more well-known grid computing applications is the SETI@home project 

15 fhttp://setiathome. ssLberkeley.edu) sponsored by the Search for Extraterrestial hitelligence with 
support from The Planetary Society, 65 North Catalina Avenue, Pasadena, California 91106- 
2301 USA (http:/ /www.planetarv.org) . SETL@home is a computing effort fliat utiUzes inmiense 
amounts of computing power. In a nutshell, each client in the grid analyzes a small portion of a 
huge volume of radio telescope data, to mine for extraterrestial radio communications or other 

20 evidence of extraterrestial life. The radio telescope data is, by-and-large, simply radio-frequency 
background noise generated by the universe, and therefore the task of discerning an 
extraterrestial broadcast within that data is an enormous undertaking. The undertaking is 
perceived to have low odds of success and little obvious conun^cial value, thereby making the 
use of a supercomputer to perform this task cost prohibitive. The SETIfgthome project is thus 

25 perceived to be an ideal task for grid computing. To participate, individuals with personal 
computers connected to the hitemet go to the SETI Web site and download a special Screensaver. 
The Screensaver volunteers the individual computer to be a client in a grid of thousands of client 
computers. SETFs system assigns portions of the data to be processed by each individual client 
computer. 

30 SETI@home is, however, but one example of the potential for grid computing. In 

general, grid computing can offer computing power to individuals and institutions that would not 
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Otherwise have access to supercomputers. 

One problem common that is grid computing is the management of each client machine. 
Numerous problems can arise when trying to manage any particular computing task, problems 
that are exacerbated as more and more machines participate in the task. For example, in the 
5 SETI@home project each client machine is typically owned and operated by individuals, who 
may at any given time choose to "drop out" of participating in the grid computing application. 
Even where those individuals themselves choose to remain, problems with any individual client, 
or network problems between the manage and client, will frustrate the performance of the larger 
computing task. The manager must thus keep track of the performance of each client and 

10 accommodate failures in order to properly complete the task. 

It is expected that certain problems of grid computing can be overcome with the Open 
Grid Services Architecture ("OGSA"), which promises to provide a common standard that will 
make the implementation of software applications via grid computing relatively straightforward 
to implement. Thus, manager and client machines that are OGSA compliant will at least be able 

15 to use the OGSA layer to handle, in a standardized fashion, at least some of the connectivity 
issues between the manager and the clients. 

However, even with the OGSA, problems remain. Each client in a grid is inherently 
unreliable, either due to client or network failure, making performance of the task less reliable 
than simply running the task on a supercomputer. Problems are further exasperated by the fact 

20 that there can be a delay before the master detects the failure of any given client. Still further 
problems arise upon detection of the failure of a particular client, as it is can be necessary to 
restart the entire task if that failed client happened to be performing some critical portion of the 
task. 

25 Summary of the Invention 

It is an object of the preset invention to provide a method and system for grid computing 
that obviates or mitigates at least one of Ihe above-identified disadvantages of the prior art. 

In an aspect of the present invention there is provided a manager for use in a system of 

grid computing. The manager can be a computing device, such as a server, that comprises a 

30 processor that is programmed to rend^ the manager operable to define a computing task based 

on data received by the processor. The processor is further operable to assign a portion of the 
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task to each of a plurality of clients that are connected to the manager via a network. The 
processor is also operable to approximate a result of each portion of the task if the client fails to 
return its result to the manager. 

The task can be one of plurality of repeatable operations, that th^selves include a 
5 plurality of sub-operations, and wherein an approximation of the sub-operation introduces an 
predefined accepted level of oior to a performance of the task. Typically, the sub-operations can 
be applied substantially independently of said other sub-operations. The task can be an n-body 
type problem, such as the type that is solvable using the Bames-Hut operation. 

Another aspect of the invention provides a method of grid computing comprising the 
10 steps of: 

receiving data respective to a computing task; 

defining the task based on the received data; 

assigning a portion of the task to each of a plurality of clients based on the defining step; 
awaiting receipt of results of the portions from the clients; 
1 5 approximating the results for any clients where the results are not received; 

compiling the received results and the approximated results; and, 
outputting the results in a pre-defined format. 

Another aspect of the invention provides a system of grid computing comprising a 
20 manager operable to define a computing task and assign a portion of the task to each of a 
plurality of clients that are connected to the manager via a network. The manager is fiirther 
operable to approximate a result of the portion if the client fails to return the result to the 
manager. 

Another aspect of the invention comprises a computer-readable media comprising a 
25 plurality of computing instructions for a manager that connectable to a plurality of clients via a 
network. The computing instructions are for defining a computing task and assigning a portion 
of the task to each of the clients. The instructions include steps for approximating a result of the 
portion of the task, if the client Mis to return the result to the manager. 

30 Brief Description of the Drawings 

The present invention will now be explained, by way of example only, with reference to 
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certain embodiments and the attached Figures in which: 

Figure 1 is a schematic representation of a system for grid computing in accordance with 
an embodiment of the invention; 

Figure 2 is a representation of a plurality of stars within a galaxy for which movements of 
S those stars is to be determined using the system in Figure 1 ; 

Figure 3 is a flow-chart depicting a method of grid computing in accordance with another 
embodiment of the invention; 

Figure 4 shows the galaxy of Figure 2 being sub-divided using the method of Figure 3; 

Figure 5 shows the galaxy of Figure 4 being further sub-divided using the method of 
10 Figure 3; 

Figure 6 shows a tree representative of the sub-division of the galaxy of Figure 5 that is 
prepared using the method Figure 3; and, 

Figure 7 is a flow-chart d^icting a method of sub-steps for performing one of the steps 
in the method of Figure 3. 

15 

Description of die Invention 

Referring now to Figure 1, a system for grid computing is indicated generally at 20. 
System 20 includes a master 24 connected to a plurality of clients 28 1, 282 ... 28n. (Collectively 
"clients 28" and generically "client 28'*,) Master 24 and clients 28 are connected via a network 

20 32 such as the hitemet, but network 32 can be another type of network as desired Master 24 
can be any type of computing device operable to manage a grid computing task, such as an IBM^ 
Pseries running Linux®. Clients 28 are typically a diverse range of relatively low-power personal 
computing devices, such as any Litel®-based personal computers based on the Pentiiun® chipset, 
or iMacs® from Apple® respectively ruiming a suitable operating sj^tem. In a present 

25 embodiment, software executing on master 24 and cUents 28 is OGSA compliant to handle 
connectivity via network 32. 

Before describing system 20 and its operation further, an example of a computing task 
that can be performed on system 20 will now be described. Referring now to Figure 2, a galaxy 
is indicated generally at 40. Galaxy 40 is comprised of a plurality of stars 44i, 442 447, 

30 (Collectively "stars 44*' and generically "star 44".) For each star 44, its mass and the 
coordinates of its location within galaxy 44 is known. System 20 is operable to perform the 
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computing task of determining the movement of stars 44 over time. Those of skill in the art will 
now recognize that this exemplary task is a simplified "n-body'* type problem, with the common 
task of determining the distances (denoted herein with the variable "r") between each one of the 
stars 44. It will also thus become apparent to those of skill in the art that system 20 can be used 
5 to perform other types of, and far more complex and/or multi-dimensional n-body problems. 

Figure 3 shows a method of grid computing in accordance with another embodiment of 
the invention that is indicated generally at 100. In particular, method 100 depicts a set of steps 
for operating system 20 that can be used to perform the task of determining the movement of 
stars 44. It is contemplated that the following discussion of method 100 will assist in the 
1 0 understanding of system 20, and vice-versa. However, tiiose of skill in the art will recognize that 
the operation and sequence of steps of method 100 can be varied, and need not actually be 
implemented on a system identical to system 20, and such variations are within the scope of the 
invention, 

Begirming first at step 1 10, a task is defined. When implemented on system 20, manager 
IS 24 performs step 1 10. Continuing with the example of performing the task of determining the 
movement of stars 44 in galaxy 40, manager 24 will perform step 1 10 by building a tree that 
divides this task into smaller portions, to the present embodiment, manager 24 will thus analyze 
the data associated with galaxy 40 and build a tree using the well-known Barnes-Hut operation to 
recursively subdivide galaxy 40 in order to simplify determination of distances between stars 44, 
20 and thereby to determine their accelerations and movements over time. (For a detailed discussion 
of the Barnes-Hut operation, see Josh Barnes and Piet Hut, A Hierarchical 0(N log N) Force 
Calculation Algorithm, Nature, 324, 4 December 1986, the contents of which are incorporated 
herein by reference.) 

Referring now to Figure 4, galaxy 40 is shown having been divided into a square 48 
25 whose sides are of equal length. The length of the sides is the maximum spatial extent (denoted 
herein with the variable "E") of stars 44 in any spatial dimension. Using Bames-Hut, galaxy 40 
is thus defined by square 48 whose side is the maximum extent between the stars 44 therein, 
namely between star 442 and star 446. The square is divided into four quadrants 52i, 522, 523 and 
524. 

30 As shown in Figure 5, galaxy 40 is then sub-divided recursively using the Bames-Hut 

approach to evenly divide galaxy 40 and quadrants 52 thereof until there is one or no star 44 
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within a given sub-division. For example, since quadrant 522 only contains one star 44) it need 
not be subdivided. 

As shown in Figure 6, the resuhs of the subdividing shown in Figures 4 and 5 is then 
assembled into a tree 60 in accordance with the Barnes-Hut operation. The root of tree 60 is 
5 indicated at 62, and represents the entire galaxy 40. Tree 60 has a plurality of leaves 64, which 
respectively represent a quadrant 52 or a star 44, depending on whether a subdivision was 
performed or not on a particular region of galaxy 40. Thus, leaf 642 represents star 44i, while 
leaves 64i, 643, 644 represent quadrants 52i, 523 and 524 respectively. By the same token, leaves 
645, 646, . . . 64io represent stars 442, 44$ , 44$, 446, 444 and 44? respectively. The contents of each 

10 of those leaves 64 will thus include information relevant to its respective star 44, i.e. its mass, 
precise location within galaxy 40, and any other infomiation that is desired, such as an initial 
acceleration and velocity. 

Thus, the buildmg of tree 60 by manager 24 from the data representing galaxy 40 
represents the cxihnination of the performance of step 1 10 in method 100. 

15 Method 100 then advances from step 110 to step 120, at which point a portion of the 

computing task is assigned to each client within the grid. When implemented on system 20, 
manager 24 performs step 120. Continuing with the example of determining movement of stars 
44, manager 24 will thus take tree 60 and assign portions of tree 60 to various clients 28 within 
system 20 according to the distribution of stars 44 in tree 60. For example, manager 24 can 

20 assign: 

a) a first portion to client 28 1, namely stars 442, 443 and 44i to according to the contents 
of leaves 645, 646 and 642 respectively; 

b) a second portion to client 282, namely stars 445 and 446 to client 282 according to the 
contents of leaves 64? and 64$ respectively; and 

25 c) a third portion to client 28n, namely stars 444 and 44? according to the contents of 

leaves 649 and 64io respectively. 

In a preset embodiment, such assigmnent of portions of the task is performed via an 
OGSA facility available in manager 24 and clients 28. Having so assigned portions of the task, 
each client 28 will utilize the data passed thereto at step 120 to determine the total acceleration 

30 on each of the respective stars 44 due to the other stars 44 in the galaxy 40 for the respective 

stars 44 that it was assigned to process in accordance with the Bames-Hut operation. In other 
CA9-2003-0071 6 



CA 02444835 2003-10-10 



words, each client 28 is used to walk a respective portion of tree 60 in accordance with the 
Barnes-Hut operation. 

Method 100 then advances to step 130, at which point the results generated by the clients 
are compiled. In a present embodiment, step 130 can be performed over a number sub-steps, 
5 indicated generally as method 1 30a in Figure 7. Referring now to Figure 7, at step 1 3 1 there is a 
wait-state to receive the results of assigned portions of the task. When using system 20, manager 
24 will perform step 131, waiting for a particular client 28 to pass the results of that client 28 's 
p^onnance of the task that was assigned at step 120. The wait at step 131 can be based on 
various criteria, such as a simple time-delay, and/or it can be based on receipt of a message from 

10 a particular client 28 that a result is, or is not, going to be forthcoming from that particular client 
28, and/or it can be based on receipt of a message from equipment that operates network 32 that 
indicates to manager 24 that a particular client 28 is no longer connected to network 32. 
Whatever the criteria used at step 131, when method 130a advances to step 132, a determination 
is made as to whether results were actually received from that particular client 28 for which 

1 5 manager 24 was waiting at step 131. If results were received at manager 24 from that particular 
client 28, then method 130a advances from stop 132 to step 133, and those received results are 
included in the compilation of results. Thus, according to the specific example discussed above, 
where client 282 completes its determination of the acceleration of stars 445 and 446 and returns 
those results to manager 24, then those results are included as part of the compilation of all 

20 results collected by manager 24. 

However, if, at step 132, no results are actually received for a particular client 28, then 
the method advances to step 134 where an approximation is made of the results that were 
expected from that particular client. Such an approximation is typically made by manager 24. 
According to the specific example discussed above, where, for example, client 28n fails to return 

25 the results of its determination of acceleration of stars 444 and 447, then manager 24 will use an 
approximation of that acceleration. During an initial cycling of method 100, such an 
approximation can be the same initial accelwation (or velocity, if desired) of stars 444 and 44? 
that was originally sent to client 28n during the assignment of the portion of the overall task that 
was performed at step 120, Alternatively, method 100, and method 130a have successfiilly 

30 cycled more than once and during a previous cycle results (i.e. the acceleration of stars 444 and 

44?) were actually received from that client 28^, then the last-received acceleration results from 
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client 28n will form the approximation at step 134. Other means of having manager 24 perform 
the approximation will now occur to those of skill in the art. Method 130a then advances from 
step 134 to step 133, and the particular approximation generated at step 134 is used in the 
compilation of results performed at step 133. 
5 Method 130a then advances to step 135, where a determination is made as to whether all 

clients have been accounted for. If all clients have not been accounted for, then method 130a 
advances to step 136, where the manager's attention is moved to the next client, and then the 
method 130a returns to step 131 to begin anew of that next client. If, at step 135, however, all 
clients have been accounted for, then the method advances to step 137 and all of the results are 

10 compiled. Thus, when step 137 is performed in relation to the determination of the movement of 
die stars 44 of galaxy 40, manager 24 will use the accelerations received, or approximated, in 
relation to tree 60 to determine the movements, and new locations, of stars 44 within galaxy 40. 

Method 130a is thus completed, and by extension, step 130 is also daus completed, and 
so, referring again to Figure 3, method 100 advances to step 140 and a determination is made as 

1 5 to whether the task is complete. In the specific example of determining the movement of stars 44 
in galaxy 40, if further detmninations are needed or desired to ascertain the movements of stars 
44 in galaxy 40, then the method will return to step 110 so method 100 can begin anew. 
However, if no further determination are needed, or desired, then the task is complete and 
method 100 ends. 

20 While only specific combinations of the various features and components of the present 

invention have been discussed herein, it will be apparent to those of skill in the art that desired 
subsets of the disclosed features and components and/or altemative combinations of these 
features and components can be utilized, as desired. For example, the steps of methods 100 and 
130a need not be performed in the exact sequence, or format as shown. 

25 Furthermore, it should be reiterated that system 20 and method 100 were described in 

relation to a simplified computing task of determining movements of stars within a two- 
dimensional galaxy. It should now be apparent that the teachings herein can be utilized to 
determine more general, and multi-dimensional, n-body type problems that can be described has 
having in common a determmation of: 

30 — or, more generically, — 
r r 

CA9-2003^071 8 



CA 02444835 2003-10-10 



for a number of objects, where r is the distance between those objects, and x is any real number. 
In still more general terms, it is to be understood that the teachings herein can be applied to 
operations where relationships can be occasionally approximated with minimal, or otherwise 
acceptable, impact on the overall results. Such objects can be masses or charged particles, or any 
5 other type of object to which an n-body type problem is applicable. 

It is also to be understood that the teachings herein can be applied to a variety of tasks» 
other than n-body type problems, that may share characteristics that are similar to n-body type 
problems. In general, the teachings herein can be used to handle computing tasks comprising 
repeatable operations that include a number of sub-operations, where those sub-operations can be 

10 applied a plurality times substantially independently of the other sub-operations. Examples of 
real-world tasks include determinations of: a) movements of masses in the universe or a given 
space; b) particle charges; c) electromagnetic fields in electronic circuits or other contexts; d) 
fluid dynamics in a fluid system; e) weather patterns; f) equity fluctuations in financial markets; 
and/or g) movements of objects in multi-player games. Other examples of tasks that can be 

1 5 performed using the teachings herein will occur to those of skill in the art. 

A variety of enhancements to system 20, method 100 and method 130a are also 
contemplated and within the scope of the invention. For example, manage" 24 can be configured 
to perform load balancing based on a pattern of failures or odier experiences of waiting for client 
resuhs at step 131. If, for example, manager 24 finds on a given cycling of method 130a that 

20 client 282 returns results more quickly than client 28 1, then manager 24 can elect during 
subsequent cycles of step 120 to assign a greater portion of the overall task to client 28 1, and a 
smaller portion to client 282, or to elect to stop using client 282 altogether. More specifically, 
during a subsequent cycling of step 120, manager 24 can elect to assign: 
a) stars 442, 443 and 44i to client 282; 

25 b) stars 44s and 44^ to client 28i; and 

c) stars 444 and 44? to client 28n. 
Such load-balancing can be performed on the fly, fix>m cycle-to-cycle of method 100, as desired. 
Alternatively, where a given client 28 is effectively disconnected from network 32, then manager 
24 can assign that portion to the remaining clients 28. For example, if client 28n discoimected 

30 firom network 32, then manager 24 can elect to assign portions of the task as follows: 

a) stars 442, 443, 44i,444 and 44? to client 282; and, 
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b) Stars 445 and 446 to client 28i. 
Conversely, as new clients 28 join network 32, then manager 24 can further distribute task- 
portions amongst the full set of clients 28. In general, it should be understood that the number 
of leaves 64 need not correspond to the number of available clients 28. Additional types of load- 
S balancing techniques will now occur to those of skill in the art. 

As another enhancement, manager 24 can be provided with a metric that represents a 
threshold of a degree of error in the poformance of its task that is acceptable or desirable. Thus, 
for example, where manage 24 has had to perform some predetermined, excessive number of 
approximations at step 134, then manager 24 can be operated to perform a series of catch-up 

10 cycles, whmin the failed task portions assigned to particular clients 28 for which 
approximations were made are actually reassigned to other clients 28, while further cycles are 
delayed imtil the approximations are substituted for correct results. Again, the point at which 
manager 24 institutes such corrective action can be based on any desired criteria, and the way 
such corrective action is implemented can be chosen. For example, where a given portion of a 

1 S task is relatively straightforward, it can be desired to have manager 24 actually perform the task- 
portion itself, rather tihan assigning that portion to a client 28. 

The aforementioned threshold of degree of error in the performance of the task can also 
be used to determine what kinds of tasks can be performed by system 20. System 20 can be 
particularly suitable where approximations are acceptable in performance of all or part of the 

20 task at hand. 

Furthermore, while the task discussed in reference to galaxy 40 of Figure 2 involves the 
assignment of all aspects of the task to each client 28, it should be understood that oHiec types of 
tasks can include input from a particular client 28. For example, where manager 24 is 
coordinating a playing arena in a multi-player game, and each cUent 28 represents a participant 

25 in the game, then the task can include manager 24 assigning each client 28 the responsibility of 
determining where that participant is located in the arena, but such determination will also 
include user-input from the individual operating that particular client 28, as that individual 
selects where the participant is to move witiiin the arena. Thus, where a client 28 momentarily 
''drops-out" of the game, manage 24 can approximate the movement of the participant until the 

30 client 28 rejoins. This type of variation can also be applicable to tasks involving weather 

determinations, as various clients 28 represent weather stations fliat contribute local weather 
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condition data to the manager 24. This type of variation can also be applicable to tasks involving 
tracking pricing of products in financial markets, as each client 28 can represents a particular 
trading floor of that particular product, with manager 24 tracking an aggregate market-price for a 
particular product. 

The above-described embodiments of the invention are intended to be examples of the 
present invention and alterations and modifications may be effected thereto, by those of skill in 
the art, without departing firom the scope of the invention which is defined solely by the claims 
appended hereto. 
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CLAIMS 

The embodiments of the invention in which an exclusive property or privilege is claimed are 
defined as follows: 

1. A manager for use in a system of grid computing comprising a processor operable to 
5 define a computing task based on data received by said processor, said processor further 

operable to assign a portion of said task to each of a plurality of clients connected to said 
manager via a network, said processor further operable to approximate a result of said 
portion if said client fails to return said result to said manager. 



10 2. The manager of claim 1 wherein said task is one of plurality of repeatable operations, 
said task including a plurality of sub-operations, and wherein an approximation of said 
sub-operation introduces a predefined accepted level of error to a performance of said 
task. 



IS 3. The manager according to claim 2 wherein said sub-operations can be applied 
substantially independently of said other sub-operations. 

4, The manager according to claim 3 wherein said task is an n-body type problem. 

20 5. The manager according to claim 4 wherein said n-body type problem is performed using 
the Barnes-Hut operation. 



6. A method of grid computing comprising the steps of: 
receiving data respective to a computing task; 
25 defining said task based on said received data; 

assigning a portion of said task to each of a plurality of clients based on said 
defining step; 

awaiting receipt of results of said portions fix)m said clients; 

approximating said results for any clients where said results are not received; 

30 compiling said received results and said approximated results; and, 

outputting said results in a pre-defined format. 
CA9-2003-a071 12 
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7. The method of claim 6 comprising the additional step of, prior to said outputting step, of 
repeating all foregoing steps until a desired level of performance of said task is achieved. 

5 8. The method of claim 6 wherein said task is one of plurality of repeatable operations, said 
task including a plurality of sub-op^ations» and wherein an approximation of said sub- 
operation introduces an acceptable level of error to a performance of said task. 

9. The method of claim 6 wherein said sub-operations can be applied substantially 
1 0 independently of said other sub-operations. 

10. The method of claim 9 wherein said task is an n-body type problem. 

11. The method of claim 10 wherein said n-body type problem can be performed using the 
1 5 Barnes-Hut operation. 

12. A system of grid computing comprising: a manager operable to define a computing task 
and assign a portion of said task to each of a plurality of clients connected to said 
manager via a network, said manager further operable to approximate a result of said 

20 portion if said client fails to return said result to said manager. 

13. A computer-readable media comprising a plurality of computing instructions for a 
manager cormectable to a plurality of clients via a network, said computing instructions 
for defining a computing task and assigning a portion of said task to each of said clients, 

25 said instructions including steps for approximating a result of said portion if said client 

fails to return said result to said manager. 

14. The computer-readable media of claim 13 wherein said task is one of plurality of 
repeatable operations, said task including a plurality of sub-operations, and wherein an 

30 approximation of said sub-operation introduces a predefined accepted level of error to a 

performance of said task. 
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15. The computer-readable media of claim 14 wherein said sub-operations can be applied 
substantially independently of said other sub-operations. 

5 16. The computer-readable media of claim 14 wherein said task is an n-body type problem. 

17. The computer-readable media of claim 16 wherein said n-body type problem is 
performed using the Barnes-Hut operation. 

10 18. The computer readable media of claim 13 wherein said task is selected from the group 
consisting of determining a) movements of masses in a given space; b) charges of 
particles; c) electromagnetic fields; d) fluid dynamics in a fluid system; e) weather 
patterns; f) equity fluctuations in financial markets; and g) movements of objects in 
multi-player games. 

15 
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